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Abstract 

We solve for the equilibrium dynamics of information sharing in a large pop- 
ulation. Each agent is endowed with signals regarding the likely outcome of a 
random variable of common concern. Individuals choose the effort with which 
they search for others from whom they can gather additional information. When 
two agents meet, they share their information. The information gathered is fur- 
ther shared at subsequent meetings, and so on. Equilibria exist in which agents 
search maximally until they acquire sufficient information precision, and then min- 
imally. A tax whose proceeds are used to subsidize the costs of search improves 
information sharing and can in some cases increase welfare. On the other hand, 
endowing agents with public signals reduces information sharing and can in some 
cases decrease welfare. 
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1 Introduction 



We characterize the equihbrium dynamics of information sharing in a large population. 
An agent's optimal current effort to search for information sharing opportunities de- 
pends on that agent's current level of information and on the cross-sectional distribution 
of information quality and search efforts of other agents. Under stated conditions, in 
equilibrium, agents search maximally until their information quality reaches a trigger 
level, and then minimally. In general, it is not the case that raising the search-effort 
policies of all agents causes an improvement in information sharing. This monotonicity 
property does, however, apply to trigger strategies, and enables a fixed-point algorithm 
for equilibria. 

In our model, each member of the population is endowed with signals regarding the 
likely outcome of a Gaussian random variable Y of common concern. The ultimate utility 
of each agent is increasing in the agent's conditional precision of Y. Individuals therefore 
seek out others from whom they can gather additional information about Y. When agents 
meet, they share their information. The information gathered is then further shared at 
subsequent meetings, and so on. Agents meet according to a technology for search and 
random matching, versions of which are common in the economics literatures covering 
labor markets, monetary theory, and financial asset markets. A distinction is that the 
search intensities in our model vary cross-sectionally in a manner that depends on the 
endogenously chosen efforts of agents. 

Going beyond prior work in this setting, we capture implications of the incentive 
to search more intensively whenever there is greater expected utility to be gained from 
the associated improvement in the information arrival process. Of course, the amount 
of information that can be gained from others depends on the efforts that the others 
themselves have made to search in the past. Moreover, the current expected rate at 
which a given agent meets others depends not only on the search efforts of that agent, 
but also on the current search efforts of the others. We assume complementarity in 
search efforts. Specifically, we suppose that the intensity of arrival of matches by a given 
agent increases in proportion to the current search effort of that agent, given the search 
efforts of the other agents. Each agent is modeled as fully rational, in a sub-game-perfect 
Bayes-Nash equilibrium. 

The existence and characterization of an equilibrium involves incentive consistency 
conditions on the jointly determined search efforts of all members of the population 
simultaneously. We find conditions for a stationary equilibrium, in which each agent's 
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search effort at a given time depends only on that agent's current level of precision 
regarding the random variable Y of common concern. Each agent's life-time search 
intensity process is the solution of a stochastic control problem, whose rewards depend 
on the optimal search intensity processes of all other agents. 

We show that if the cost of search is increasing and convex in effort, then, taking 
as given the cross-sectional distribution of other agents' information quality and search 
efforts, the optimal search effort of any given agent is declining in the current infor- 
mation precision of that agent. This property holds, even out of equilibrium, because 
the marginal valuation of additional information for each agent declines as that agent 
gathers additional information. With proportional search costs, this property leads to 
equilibria with trigger policies that reduce search efforts to a minimal level once a suffi- 
cient amount of information is obtained. Our proof of existence relies on a monotonicity 
result: Raising the assumed trigger level at which all agents reduce their search efforts 
leads to a first-order dominant cross-sectional distribution of information arrivals. 

We show by counterexample, however, that for general forms of search-effort poli- 
cies it is not generally true that the adoption of more intensive search policies leads to 
an improvement in population-wide information sharing. Just the opposite can occur. 
More intensive search at given levels of information can in some cases advance the onset 
of a reduction of the search efforts of agents who may be a rich source of information to 
others. This can lower access to richly informed agents in such a manner that, in some 
cases, information sharing is actually poorer. 

The paper ends with an analysis of the welfare effects of policy interventions. First, 
we analyze welfare gains that can be achieved with a lump-sum tax whose proceeds are 
used to subsidize the costs of search efforts. Under stated conditions, we show that 
this promotes positive search externalities that would not otherwise arise in equilibrium. 
Finally, we show that, with proportional search costs, additional public information leads 
in equilibrium to an unambiguous reduction in the sharing of private information, to the 
extent that there is in some cases a net negative welfare effect. 

2 Related Literature 

Previous research in economics has investigated the issue of information aggregation. 
A large literature has focused on the aggregation of information through prices. For 
example, Grossman (1981) proposed the concept of rational-expectations equilibrium 
to capture the idea that prices aggregate information that is initially dispersed across 
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investors. Wilson (1977), Milgrom (1981), Pesendorfer and Swinkels (1997), and Reny 
and Perry (2006) provide strategic foundations for the rational-expectations equilibrium 
concept in centralized markets. 

In many situations, however, information aggregation occurs through local interac- 
tions rather than through common observation of market prices. For example, in decen- 
tralized markets, such as those for real estate and over-the-counter securities, agents learn 
from the bids of other agents in private auctions or bargaining sessions. Wolinsky (1990) 
and Blouin and Serrano (2002) study information percolation in decentralized markets. 
In the literature on social learning, agents communicate with each other and choose ac- 
tions based on information received from others. Banerjee and Fudenberg (2004), for 
example, study information aggregation in a social- learning context. 

Previous literature has shown that some forms of information externalities may 
slow down or prevent information aggregation. For example, Vives (1993) and Amador 
and Weill (2007) show that information aggregation may be slowed when agents base 
their actions on public signals (price) rather than on private signals, making inference 
noisier. Bikhchandani, Hirshleifer, and Welch (1992) and Banerjee (1992) show that 
agents may rely on publicly observed actions, ignoring their private signals, giving rise 
to informational cascades that prevent social learning. 

Our paper studies information aggregation in a social learning context. In contrast 
to previous studies, we analyze the equilibria of a game in which agents seek out other 
agents from whom they can gather information. This introduces a new source of infor- 
mation externality. If an agent chooses a high search intensity, he produces an indirect 
benefit to other agents by increasing both the mean arrival rate at which the other agents 
will be matched and receive additional information, as well as the amount of information 
that the given agent is able to share when matched. We show that because agents do not 
take this externality into account when choosing their search intensities, social learning 
may be relatively inefficient or even collapse. 

In addition to the information externality problem, our paper shows that coordi- 
nation problems may be important in information aggregation problems. In our model, 
there are multiple equilibria that are Pareto-ranked in terms of the search intensity 
employed by the agents. If agents believe that other agents are searching with lower in- 
tensity, agents will also search with lower intensity, producing an equilibrium with slower 
social learning. Pareto-dominant equilibria, in which all agents search with higher in- 
tensity, may be possible, but it is not clear how agents will coordinate to achieve such 
equilibria. 



3 



Our technology of search and matching is similar to that used in search-theoretic 
models that have provided foundations for competitive general equilibrium and in models 
of equilibrium in markets for labor, money, and financial assets, l] Unlike these prior 
studies, we allow for information asymmetry about a common- value component, with 
learning from matching and with endogenously chosen search efforts. 

Our model is related to that of Dufiie and Manso (2007) and Dufiie, Giroux, and 
Manso (2008), which provide an explicit solution for the evolution of posterior beliefs 
when agents are randomly matched in groups over time, exchanging their information 
with each other when matched. In contrast to these prior studies, however, we model the 
endogenous choice of search intensities. Moreover, we deal with Gaussian uncertainty, 
as opposed to the case of binary uncertainty that is the focus of these prior two papers. 
Further, we allow for the entry and exit of agents, and analyze the resulting stationary 
equilibria. 

3 Model Primitives 

A probability space {Q, JF, P) and a non-atomic measure space {A, A, a) of agents are 
fixed. We rely throughout on applications of the exact law of large numbers (LLN) 
for a continuum of random variables. A suitably precise version can be found in Sun 
(2006), based on technical conditions on the measurable subsets of Q x A. As in the 
related literature, we also rely formally on a continuous-time LLN for random search 
and matching that has only been rigorously justified in discrete-time settings!^ An 
alternative, which we avoid for simplicity, would be to describe limiting results for a 
sequence of models with discrete time periods or finitely many agents, as the lengths of 
time periods shrink or as the number of agents gets large. 

All agents benefit, in a manner to be explained, from information about a particular 
random variable Y. Agents are endowed with signals from a space S. The signals are 
jointly Gaussian with Y. Conditional on Y, the signals are pairwise independent. We 
assume that Y and all of the signals in S have zero mean and unit variance, which is 
without loss of generality because they play purely informational roles. 

Agent i enters the market with a random number iVjo of signals that is independent 



^Examples of theoretical work using random matching to provide foundations for competitive equi- 
hbrium include that of Rubinstein and Wolinsky (1985) and Gale (1987). Examples in labor economics 
include Pissaridcs(1985) and Mortcnscn (1986); examples in monetary theory include Kiyotaki and 
Wright (1993) and Trejos and Wright (1995); examples in finance include DufSe, Garleanu, and Peder- 
sen (2005) and Weill (2004). 

2 See Duffie and Sun (2007). 
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of Y and S. The probability distribution vr of NiQ does not depend on i. For almost 
every pair {i,j) of agents, Nio and Njo are independent, and their signal sets are disjoint. 

When present in the market, agents meet other agents according to endogenous 
search and random matching dynamics to be described. Under these dynamics, for 
almost every pair of agents, conditional on meeting at a given time t, there is zero 
probability that they meet at any other time, and zero probability that the set of agents 
that i has met before t overlaps with the set of agents that j has met before t. 

Whenever two agents meet, they share with each other enough information to 
reveal their respective current conditional distributions of Y. Although we do not model 
any strict incentive for matched agents to share their information, they have no reason 
not to do so. We could add to the model a joint production decision that would provide 
a strict incentive for agents to reveal their information when matched, and have avoided 
this for simplicity. 

By the joint Gaussian assumption, and by induction in the number of prior meet- 
ings that each has had, it is enough that each of two matched agents tells the other his 
or her immediately prior conditional mean and variance of Y. The conditional variance 
of Y given any n signals is 



where p is the correlation between Y and any signal. Thus, it is equivalent for the purpose 
of updating the agents' conditional distributions of Y that agent i tells his counterparty 
at any meeting at time t his or her current conditional mean of Y and the total 
number of signals that played a role in calculating the agent's current conditional 
distribution of Y. This number of signals is initially the endowed number N^q, and is 
then incremented at each meeting by the number Njt of signals that similarly influenced 
the information about Y that had been gathered by his counterparty j at time t 

Because the precision l/v{Nit) of the conditional distribution of Y given the infor- 
mation set J-'it of agent i at time t is strictly monotone in N^, we speak of "precision" 
and Nit interchangeably. 

Agents remain in the market for exponentially distributed times that are indepen- 
dent (pairwise) across agents, with parameter rj'. If exiting at time t, agent i chooses an 
action A, measurable with respect to his current information jFjj, with cost {Y — A)^. 
Thus, in order to minimize the expectation of this cost, agent i optimally chooses the ac- 
tion A = E(Y I J-'it), and incurs an optimal expected exit cost equal to the jFjj-conditional 
variance aft of Y. Thus, while in the market, the agent has an incentive to gather in- 
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formation about Y in order to reduce the expected exit cost. We will shortly explain 
how search for other agents according to a costly effort process (p influences the current 
mean rate of arrival of matches, and thus the information filtration {J-'u : t > 0}. Given 
a discount rate r, the agent's lifetime utility (measuring time from the point of that 
agent's market entrance) is 



where r is the exit time and K{c) is the cost rate for search effort level c, which is 
chosen at each time from some interval [ci,c//] C M^. We take the cost function K to 
be bounded and measurable, so U (0) is bounded above and finite. 

As we will show, essentially any exit utility formulation that is concave and de- 
creasing in (Jjy would result in precisely the same characterization of equilibrium that we 
shall provide. 

The agent is randomly matched at a stochastic intensity that is proportional to 
the current effort of the agent, given the efforts of other agents. This proportionality 
assumption means that an agent who exerts search effort c at time t has a current 
intensity (conditional mean arrival rate) of cbqb of being matched to some agent from the 
set of agents currently using effort level b at time t, where is the current fraction of 
the population using effort b. More generally, if the current cross-sectional distribution 
of effort by other agents is given by a measure e, then the intensity of a match with 
agents whose current effort levels are in a set i? is c J^bde{b). The particular pairings of 
counterparties are randomly chosen, in the sense of the law of large numbers for pairwise 
random matching of Duffie and Sun (2007). 

Agents enter the market at a rate proportional to the current mass qt of agents in 
the market, for some proportional "birth rate" rj > 0. Because agents exit the market 
pairwise independently at intensity 77', the law of large numbers implies that the total 
quantity qt of agents in the market at time t is qt = qoe^"^'"^'^^ almost surely. 

The cross-sectional distribution fit of information precision at time t is defined, at 
any set B of positive integers, as the fraction fit{B) = a{{i : N^t G B})/qt of agents 
whose precisions are currently in the set B. We sometimes abuse notation by writing 
/if(?7,) for the fraction of agents with precision n. 

In the equilibria that we shall demonstrate, each agent chooses an effort level 
at time t that depends only on that agent's current precision, according to a policy 
C : N — > [cl,ch] used by all agents. Assuming that such a search effort policy C is 
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used by all agents, the cross- sectional precision distribution satisfies (almost surely) the 
differential equation 

j^lit = T/(vr - lit) + /xf * /^P - /^f /if (N), (1) 

where fif'{n) = Cnfit{n) is the effort-weighted measure, fi * u denotes the convolution of 
two measures fi and u, and 

oo 

/if(N) = C,,fit{n) 

n=l 

is the cross-sectional average search effort. The mean exit rate r]' plays no role in ([T]) 
because exit removes agents with a cross- sectional distribution that is the same as the 
current population cross-sectional distribution. The first term on the right-hand side of 
([T]) represents the replacement of agents with newly entering agents. The convolution 
term /if * /if represents the gross rate at which new agents of a given precision are 
created through matching and information sharing. For example, agents of a given 
posterior precision n can be created by pairing agents of prior respective precisions k 
and n — k, for any k < n, so the total gross rate of increase of agents with precision n 
from this source is 

71-1 

(/if * /if )(n) = ^ fit{k)C{k)C{n - k)fit{n - k). 

k=l 

The final term of ([T]) captures the rate fif'{n) /if (N) of replacement of agents with prior 
precision n with those of some new posterior precision that is obtained through matching 
and information sharing. 

We anticipate that, in each state of the world u and at each time t, the joint cross- 
sectional population distribution of precisions and posterior means of Y has a density 
ft on N X R, with evaluation ft{n,x) at precision n and posterior mean x of Y. This 
means that the fraction of agents whose conditional precision-mean pair [n, x) is in a 
given measurable set i? C N x R is J2n I-^ fti^y ^)^{{n,x)eB} dx. When it is important to 
clarify the dependence of this density on the state of world G fi, we write ft{n,x,u). 

Proposition 3.1 For any search- effort policy function C, the cross-sectional distribu- 
tion ft of precisions and posterior means of the agents is almost surely given by 

ft{n,x,u) = Htin)pn{x\Y{uj)), (2) 
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where fit is the unique solution of the differential equation (Qp and pn{ - \ Y) is the Y- 
conditional Gaussian density of E{Y \ Xi, . . . , for any n signals Xi, . . . , This 
density has conditional mean 

np^Y 



l + p2(n-l) 

and conditional variance 



2 _ V(l-P') (n^ 

" (l + p2(n-l))2- 



The appendix provides a proof based on a formal application of the law of large 
numbers, and an independent proof by direct solution of the differential equation for ft 
that arises from matching and information sharing. As n goes to infinity, the measure 
with density p„( ■ | Y) converges, uohy uj (almost surely), to a Dirac measure at Y{ijj). In 
other words, those agents that have collected a large number of signals have posterior 
means that cluster (cross-sectionally) close to Y . 

4 Stationary Measure 

In our eventual equilibrium, all agents adopt an optimal search effort policy function C, 
taking as given the presumption that all other agents adopt the same policy C, and taking 
as given a stationary cross- sectional distribution of posterior conditional distributions of 
Y . Proposition 13.11 implies that this cross-sectional distribution is determined by the 
cross-sectional precision distribution pf In a stationary setting, from ([1]), this precision 
distribution /i solves 

= r7(7r-/i)+/i^*/i^-/i^/i^(N), (4) 

which can be viewed as a form of algebraic Riccati equation. We consider only solutions 
that have the correct total mass of 1. For brevity, we use the notation iii = fi{i) 
andCi = 

Lemma 4.1 Given a policy C , there is a unique measure fi satisfying the stationary- 
measure equation This measure fi is characterized as follows. For any C G [cl,Ch], 
construct a measure JJi{C) by the algorithm: 



and then, inductively, 

- (n\ V^k + Y!IZI CiCk-iJii{C)jik-i{C) 

T] + CkC 

There is a unique solution C to the equation C = X^^i P'n{C)C- Given such a C , we 
have fj. = fl{C). 

An important question is stability. That is, if the initial condition fiQ is not suf- 
ficiently near the stationary measure, will the solution path {fit : ^ > 0} converge to 
the stationary measure? The dynamic equation ([1]) is an infinite-dimensional non-linear 
dynamical system that could in principle have potentially complicated oscillatory behav- 
ior. In fact, a technical condition on the tail behavior of the effort policy function C( ■ ) 
implies that the stationary distribution is globally attractive: From any initial condition, 
/ii converges to the unique stationary distribution. 

Proposition 4.2 Suppose that there is some integer N such that Cn = Cn for n > N 
and that rj > ChC^. Then the unique solution fit of (QP converges pointwise to the unique 
stationary measure fi. 

The proof, given in the appendix, is complicated by the factor /ip(N), which is non- 
local and involves fit{n) for each n. The proof takes the approach of representing the 
solution as a series /i((2), . . .}, each term of which solves an equation similar to 

([T]), but without the factor fif\N). Convergence is proved for each term of the series. 
A tail estimate completes the proof. The convergence of fit does not guarantee that 
the limit measure is in fact the unique stationary measure fi. The appendix includes a 
demonstration of this, based on Proposition IB.13[ As we later show in Proposition 15.31 
the assumption that Cn = Cn for all n larger than some integer is implied merely by 
individual agent optimality, under a mild condition on search costs. 

Our eventual equilibrium will in fact be in the form of a trigger policy C^ , which 
for some integer A^ > 1 is defined by 

C = CH, n<N, 
= Cl, n> N. 

In other words, a trigger policy exerts maximal search effort until sufficient informa- 
tion precision is reached, and then minimal search effort thereafter. A trigger policy 
automatically satisfies the "fiat tail" condition of Proposition 14.21 
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A key issue is whether search pohcies that exert more effort at each precision level 
actually generate more information sharing. This is an interesting question in its own 
right, and also plays a role in obtaining a fixed-point proof of existence of equilibria. For 
a given agent, access to information from others is entirely determined by the weighted 
measure jjp , because if the given agent searches at some rate c, then the arrival rate 
of agents that offer n units of additional precision is cCnftn = c/i^. Thus, a first-order 
stochastically dominant (FOSD) shift in the measure /i*" is an unambiguous improvement 
in the opportunity of any agent to gather information. (A measure u has the FOSD 
dominant property relative to a measure 6 if, for any nonnegative bounded increasing 
sequence /, we have J2n fn^n > J2n fnOn-) 

The next result states that, at least when comparing trigger policies, a more in- 
tensive search policy results in an improvement in information sharing opportunities. 

Proposition 4.3 Let ji'^^ and he the unique stationary measures corresponding to 
trigger policies C^'^ and respectively. Let fi^''^ = fi^ denote the associated search- 
effort-weighted measure. If N > M, then /i*"'^ has the first-order dominance property 
over jj, ' . 

Superficially, this result may seem obvious. It says merely that if all agents extend 
their high-intensity search to a higher level of precision, then there will be an unambigu- 
ous upward shift in the cross-sectional distribution of information transmission rates. 
Our proof, shown in the appendix, is not simple. Indeed, we provide a counterexample 
below to the similarly "obvious" conjecture that any increase in the common search-effort 
policy function leads to a first-order-dominant improvement in information sharing. 

The issue of whether higher search efforts at each given level of precision improves 
information sharing involves two competing forces. The direct effect is that higher search 
efforts at a given precision increases the speed of information sharing, holding constant 
the precision distribution fi. The opposing effect is that if agents search harder, then 
they may earlier reach a level of precision at which they reduce their search efforts, 
which could in principle cause a downward shift in the cross-sectional average rate of 
information arrival. In order to make precise these competing effects, we return to 
the construction of the measure fiiC) in Lemma 14.11 and write fi{C, C) to show the 
dependence of this candidate measure on the conjectured average search effort C as well 
as the given policy C. We emphasize that fi is the stationary measure for C provided 
/i = fi{C,C) and C = J^n^nfJ^n- From the algorithm stated by Lemma l4rT| fik{C,C) 
is increasing in C and decreasing in C, for all k. (A proof, by induction in k, is given 
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in the appendix.) Now the relevant question is: What effect does increasing C have 
on the stationary average search effort, C*, solving the equation C = J2nP'n{C,C)Cn'^ 
The following proposition shows that increasing C has a positive effect on C, and thus 
through this channel, a negative effect on flk{C,C). 

Proposition 4.4 Let fi and v he the stationary measures associated with policies C 
and D. If D > C, then Ylm^n^n > Ylm^nl^n- That is, any increase in search policy 
increases the equilibrium average search effort. 

For trigger policies, the direct effect of increasing the search-effort policy C domi- 
nates the "feedback" effect on the cross sectional average rate of effort. For other types 
of policies, this need not be the shown by the following counterexample, whose 

proof is given in the appendix. 

Example 4.5 Suppose that 1x2 > Stti . Consider a policy C with C„ = for > 3. Fix 

C2 > 0, and consider variation of Ci. For Ci sufficiently close to C2, we show in the 
appendix that 

00 



is monotone decreasing in Ci . Thus, if we consider the increasing sequence 



k=2 



fi = 0, 

fn =1, n>2, 

we have f ■ fi'" = 6*2/12 strictly decreasing in Ci, for Ci in a neighborhood of C2, so we 
do not have FOSD of /i*^ with increasing C . In fact, more search effort by those agents 
with precision 1 can actually lead to poorer information sharing. To see this, consider 
the policies D = (1, 1, 0, 0, . . .) and C = (1 — e, 1, 0, 0, . . .). The measure fi^ has FOSD 
over the measure fx^ for an^ sufficiently small e > 0. 

5 Optimality 

In this section, we study the optimal policy of a given agent who presumes that precision 
is distributed in the population according to some fixed measure fi, and further presumes 



^For this, we can without loss of gcnerahty take /i = 1 and calculate that h{e) = f ■ j/^ is decreasing 
in e for sufficiently small e > 0. 
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that other agents search according to a conjectured pohcy function C . We let C = 
X]„Cn/^n denote the average search effort. 

Given the conjectured market properties (/i, C), each agent i chooses some search- 
effort process (p : Q x [0, oo) [cl, ch] that is progressively measurable with respect 
to that agent's information filtration {J-'u : t > 0}, meaning that 0t is based only on 
current information. The posterior distribution of Y given J-'u has conditional variance 
v{N{t)), where is the agent's precision process and v{n) is the variance of Y given 
any n signals. 

Assuming a discount rate r on future expected benefits, and given the conjectured 
market properties (/i,C), an agent solves the problem 

f/(0) = sup E (^-e~''^v{Nf) - e-''K{(Pt) d?j , (5) 

where r is the time of exit, exponentially distributed with parameter rj', and where the 
agent's precision process A^*^ is the pure-jump process with a given initial condition A'^o, 
with jump- arrival intensity (ptC, and with jump-size probability distribution fi'"/C, that 
is, with probability C{j)fi{j)/C of jump size j. We have abused notation by measuring 
calendar time for the agent from the time of that agent's market entry. 

For generality, we relax from this point the assumption that the exit disutility is 
the conditional variance v{Nf), and allow the exit utility to be of the more general form 
u{Nf), for any bounded increasing concavt^ function u{-) on the positive integers. It 
can be checked that u{n) = —v{n) is indeed a special case. 

We say that 0* is an optimal search effort process given (/i, C) if (p* attains the 
supremum ([5]). We further say that a policy function F : N — [cl.ch] is optimal given 
{fi,C) if the search effort process {F(A't) : t > 0} is optimal, where the precision pro- 
cess A^ uniquely satisfies the stochastic differential equation with jump arrival intensity 
T{Nt)C and with jump-size distribution fi'^/C. (Because F(?7,) is bounded by ch, there 
is a unique solution A^ to this stochastic differential equation. See Protter (2005).) 

We characterize agent optimality given (/i, C) using the principle of dynamic pro- 
gramming, showing that the indirect utility, or "value," Vn for precision n satisfies the 
Hamilton- Jacobi-Bellman equation for optimal search effort given by 



oo 



= -(r + r]')Vn + v'un+ sup {-i^(c) + c J] (K+m - V;)/i^}. (6) 



*We say that a real-valued function F on the integers is concave if F{j + 2) + F{j) < 2F{j + 1). 
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A standard martingale-based verification argument for tlie following result is found 
in the appendix. 

Lemma 5.1 If V is a bounded solution of the Hamilton- Jacobi- Bellman equation ^ 
and the policy function T satisfies the optimality condition that, for each n and for all 
c e [cl,ch], 

oo oo 

-KiTn) + r„ ^ {Vn+m - Vn)flZ > -K{c) + C ^ " 
m=l m=l 

then r is an optimal policy function given [fi, C), and Vnq is the value of this policy. 

We begin to lay out some of the properties of optimal policies, based on conditions 
on the search-cost function K{ ■ ). 

Proposition 5.2 Suppose that K is increasing, convex, and differentiable. Then, given 
{fi, C), there is a policy T that is optimal for all agents, and the optimal search effort r„ 
is monotone decreasing in the current precision n. 

In order to calculate a precision threshold A^, independent of the measure /z, above 
which it is optimal to search minimally, we let u = limnu{n) , which exists because Un 
is increasing in n and bounded, and we let 

TV = max{n : ch rj' {r + ri') {u — u{n)) > K'{cl)}, 

which is finite if K'{cl) > 0. A proof of the following result is found in the appendix. 

Proposition 5.3 Suppose that K{ ■ ) is increasing, differentiable, and convex, with K' {cl) > 
0. Then, for any optimal search-effort policy T, 

Tn = cl, n> N. 

In the special case of proportional and non-trivial search costs, it is in fact optimal 
for all agents to adopt a trigger policy, one that searches at maximal effort until a trigger 
level of precision is reached, and at minimal effort thereafter. This result, stated next, 
is a consequence of our prior results that an optimal policy is decreasing and eventually 
reaches cl, and of the fact that with linear search costs, an optimal policy is "bang- 
bang," therefore taking the maximal effort level ch at first, then eventually switching to 
the minimal effort at a sufficiently high precision. 

Proposition 5.4 Suppose that K{c) = no for some scalar n > 0. Then, given {fi,C), 
there is a trigger policy that is optimal for all agents. 
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6 Equilibrium 



An equilibrium is a search-effort policy function C satisfying: (i) there is a unique 
stationary cross-sectional precision measure /i satisfying the associated equation (jlj), 
and (ii) taking as given the market properties (/i, C), the policy function C is indeed 
optimal for each agent. Our main result is that, with proportional search costs, there 
exists an equilibrium in the form of a trigger policy. 

Theorem 6.1 Suppose that K{c) = kc for some scalar k > 0. Then there exists a 
trigger policy that is an equilibrium. 

The theorem is proved using the following proposition and corollary. We let be 
the trigger policy with trigger at precision level A^, and we let /i^ denote the associated 
stationary measure. We let ^/{N) C N be the set of trigger levels that are optimal 
given the conjectured market properties (yU^, C^) associated with a trigger level N. 
We can look for an equilibrium in the form of a fixed point of the optimal trigger-level 
correspondence A/'( ■ ), that is, some N such that N G //{N). The Theorem does not rely 
on the stability result that from any initial condition, fit converges to fi. This stability 
applies, by Proposition 14. 2^ provided that rj > chCl. 

Proposition 6.2 Suppose that K{c) = nc for some scalar k > 0. Then M{N) is in- 
creasing in N , in the sense that if N' > N and if k & N'{N), then there exists some 
k' > k inAf{N'). Further, there exists a uniform upper bound onN{N), independent of 
N , given by 

N = max{j : CH'u'{r + r]'){u — u{j)) > k,}. 

Theorem 16.11 then follows from: 

Corollary 6.3 The correspondence M has a fixed point N . An equilibrium is given by 
the associated trigger policy . 

Our proof, found in the appendix, leads to the following algorithm for computing 
symmetric pure strategy equilibria of the game. The algorithm finds all such equilibria 
in trigger strategies. 

Algorithm: Start with N = N. 
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1. Compute Af{N) . If N G Af{N), then output (an equilibrium of the game). Go 
to the next step. 

2. If N > 0, go back to Step 1 with N = N — 1. Otherwise, quit. 

There may exist multiple equilibria of the game. The following proposition shows 
that the equilibria are Pareto-ranked according to their associated trigger levels, and 
that there is never "too much" search in equilibrium. 

Proposition 6.4 Suppose that K{c) = kc for some scalar n > 0. IfC^ is an equilibrium 
of the game then it Pareto dominates any outcome in which all agents employ a policy 
(jN' ^ trigger level N' < N. In particular, the set of equilibria of the game is 
Pareto-ranked with equilibria associated with higher trigger levels dominating equilibria 
associated with lower trigger levels. 

6.1 Equilibria with Minimal Search 

We now consider conditions under which there are equilibria with minimal search, cor- 
responding to the trigger policy with trigger at = 0. The idea is that such equilibria 
can arise because a presumption that other agents make minimal search efforts can lead 
to a conjecture of such poor information sharing opportunities that any given agent may 
not find it worthwhile to exert more than minimal search effort. We give an explicit 
sufficient condition for such equilibria, a special case of which is = 0. Clearly, with 
cl = 0, it is pointless for any agent to expend any search effort if he or she assumes that 
all other agents make no effort to be found. 

Let /i° denote the stationary precision distribution associated with minimal search, 
so that C = Cl is the average search effort. The value function V of any agent solves 

CXj 

{r + r]' + cl)Vn = v'un - K{cl) + 4 ^ (7) 

m=l 

Consider the bounded increasing sequence / given by 

fn= (r + V + Clr' iv'Un - K{cl)). 

Define the operator A on the space of bounded sequences by 
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Lemma 6.5 The unique, bounded solution V to is given by 

oo 

V = {I-A)-'U) = 

0=0 

which is concave and monotone increasing. 

In order to provide simple conditions for minimal-search equilibria, let 

oo 

B = CLY.{V, + m - V,)fil > 0. (8) 

771=1 

Theorem 6.6 Suppose that K{ ■ ) is convex, increasing, and differentiable. Then the 
minimal- search policy C , that with C{n) = cl for all n, is an equilibrium if and only if 
K'{cl) > B. In particular, if cl = , then B = and minimal search is always an 
equilibrium. 

Intuitively, when the cost of search is small, there should exist equilibria with active 
search. 

Proposition 6.7 Suppose that K{c) = kg and cl = 0. //tti > and 

r + r]' 

then there exists an equilibrium trigger policy with N > 1 . This equilibrium strictly 
Pareto dominates the no-search equilibrium. 

7 Policy Interventions 

In this section, we discuss the potential welfare implications of policy interventions. First, 
we analyze the potential to improve welfare by a tax whose proceeds are used to subsidize 
the costs of search efforts. This has the potential benefit of positive search externalities 
that may not otherwise arise in equilibrium because each agent does not search unless 
others are searching, even though there are feasible search efforts that would make all 
agents better off. 

Then, we study the potentially adverse implications of providing all entrants with 
some additional common information. Although there is some direct benefit of the 
additional information, we show that with proportional search costs, additional public 



16 



information leads to an unambiguous reduction in the sharing of private information, to 
the extent that there is in some cases a net negative welfare effect. 

In both cases, welfare implications are judged in terms of the utilities of agents as 
they enter the market. In this sense, the welfare effect of an intervention is said to be 
positive it improves the utility of every agent at the point in time that the agent enters, 
and negative if it causes a reduction in the utilities of all entering agents. 

7.1 Subsidizing Search 

A policy that may help to attenuate the negative welfare effects of low information 
sharing is to institute a tax whose proceeds are used to subsidize search costs. 

We suppose for this purpose that each agent pays a lump-sum tax r at entry. 
Search costs are assumed to be proportional, at rate kc for some k > 0. Each agent is 
also offered a proportional reduction 6 in search costs, so that the after-subsidy search 
cost function of each agent is Ks{c) = {k — 6)c. The lump-sum tax has no effect on 
equilibrium search behavior, so we can solve for an equilibrium policy C, as before, 
based on an after-subsidy proportional search cost of k — 6. Because of the law of large 
numbers, the total per-capita rate rrj of tax proceeds can then be equated to the total 
per-capita rate of subsidy by setting 



The search subsidy can potentially improve welfare by addressing the failure, in a 
low-search equilibrium, to exploit positive search externalities. As Proposition 16.41 shows, 
there is never too much search in equilibrium. The following lemma and proposition show 
that, indeed, equilibrium search effort is increasing in the search subsidy rate 6. 

Lemma 7.1 Suppose that K{c) = kc for some n > 0. For given market conditions 
{fi,C), the trigger level N in the precision of an optimal policy is increasing in the 
search subsidy rate 5. That is, if N is an optimal trigger level of precision given a subsidy 
S, then for any higher search subsidy 6' > 6, there exists a higher optimal trigger N' > N. 

Coupled with Proposition 14.31 this lemma implies that an increase in the subsidy 
allows an increase (in the sense of first order dominance) in information sharing. A direct 
consequence of this lemma is the following result. 

Proposition 7.2 Suppose that K{c) = kc for some k > 0. If is an equilibrium with 
proportional search subsidy 6, then for any 6' > 6, there exists some N' > N such that 
C^' is an equilibrium with proportional search subsidy 5' . 



T = 
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Example. Suppose, for some integer > 1, that ttq = 1/2, ttn = 1/2, and cl = 0. 
This setting is equivalent to that of Proposition 16.71 after noting that every information 
transfer is in blocks of signals each, resulting in a model isomorphic to one in which 
each agent is endowed with one private signal of a particular higher correlation. Recalling 
that inequality ([9]) determines whether zero search is optimal, we can exploit continuity of 
the lefthand side of this inequality to choose parameters so that, given market conditions 
(/i^,C^), agents have a strictly positive but arbitrarily small increase in utility when 
choosing search policy C° over policy . With this, C° is the unique equilibrium. This 
is before considering a search subsidy. We now consider a model that is identical with the 
exception that each agent is taxed at entry and given search subsidies at the proportional 
rate 6. We can choose 6 so that all agents strictly prefer to C° (the strict no-search 
condition ([9]) is satisfied), and is an equilibrium. For sufficiently large all agents 
have strictly higher indirect utility in the equilibrium with the search subsidy than they 
do in the equilibrium with the same private-signal endowments and no subsidy. 

7.2 Educating Agents at Birth 

A policy that might in principle attenuate the negative welfare effects of low information 
sharing is to "educate" all agents, by giving all agents additional public signals at entry. 
We assume for simplicity that the M > 1 additional public signals are drawn from the 
same signal set S. When two agents meet and share information, they take into account 
that the information reported by the other agent contains the effect of the additional 
public signals. (The implications of the reported conditional mean and variance for the 
conditional mean and variance associated with a counterparty's non-public information 
can be inferred from the public signals, using Lemma lA.ll ) Because of this, our prior 
analysis of information sharing dynamics can be applied without alteration, merely by 
treating the precision level of a given agent as the total precision less the public precision, 
and by treating the exit utility of each agent for n non-public signals as u{n) = u{n + M). 

The public signals influence optimal search efforts. Given the market conditions 
{fi,C), the indirect utility Vn for non-public precision n satisfies the Hamilton- Jacobi- 
Bellman equation for optimal search effort given by 

oo 

= -{r + 7]')Vn + v'uM+n+ SUp { - A'(c) + C ^ (K+m - K)/^^ } ■ (10) 

celcL,CH] ^=1 

Educating agents at entry with public signals has two effects. On one hand, when 
agents enter the market they are better informed than if they had not received the extra 
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signals. On the other hand, this extra information may reduce agents' incentives to 
search for more information, slowing down information percolation. Below, we show an 
example in which the net effect is a strict welfare loss. First, however, we establish that 
adding public information causes an unambiguous reduction in the sharing of private 
information. 

Lemma 7.3 Suppose that K{c) = kc for some k > 0. For given market conditions 
{fi, C), the trigger level N in non-public precision of an optimal policy is decreasing 
in the precision M of the public signals. (That is, if N is an optimal trigger level of 
precision given public-signal precision M , then for any higher public precision M' > M , 
there exists a lower optimal trigger N' < N .) 

Coupled with Proposition 14.31 this lemma implies that adding public information 
leads to a reduction (in the sense of first order dominance) in information sharing. A 
direct consequence of this lemma is the following result. 

Proposition 7.4 Suppose that K{c) = no for some k, > 0. If is an equilibrium with 
M public signals, then for any M' < M, there exists some N' > N such that C^' is an 
equilibrium with M' public signals. 

In particular, by removing all public signals, as in the following example, we can 
get strictly superior information sharing, and in some cases a strict welfare improvement. 

Example. As in the previous example, suppose, for some integer > 1, that ttq = 1/2, 
vttv = 1/2, and cl = 0. This setting is equivalent to that of Proposition 16.71 after noting 
that every information transfer is in blocks of A^ signals each, resulting in a model 
isomorphic to one in which each agent is endowed with one private signal of a particular 
higher correlation. Analogously with the previous example, we can exploit continuity in 
the model parameters of the lefthand side of inequality ([9]), determining whether zero 
search is optimal, to choose the parameters so that, given market conditions (yU^,C^), 
agents have a strict but arbitrarily small preference of policy over C°. We now 
consider a model that is identical with the exception that each agent is given M = 1 
public signal at entry. With this public signal, again using continuity we can choose 
parameters so that all agents strictly prefer C° to (the strict no-search condition 
(Q is satisfied), and C° is the only equilibrium. For sufficiently large A^, or equivalently 
for any N > 2 and sufficiently small signal correlation p, all agents have strictly lower 
indirect utility in the equilibrium with the public signal at entry than they do in the 
equilibrium with the same private-signal endowments and no public signal. 
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Appendices 



A Proofs for Section 3: Information Sharing Model 

Lemma A.l Suppose that Y,Xi,..., X^, Zi, . . . , are joint Gaussian, and that Xi, . . . , X^ 
and Zi, . . . , Zm all have correlation p with Y and are Y- conditionally iid. Then 

E{Y\X,,...,Xr„Z -^E{Y I Xi, . . . , + -^E{Y I Z 

1 ) • • • ; Z-iYi) , 

where 7^ = 1 + p^{k — 1). 

Proof. The proof is by calculation. If {Y, W) are joint mean-zero Gaussian and W has 
an invertible covariance matrix, then by a well known result, 

E{Y I W) = W'^coy{W)~^coy{Y, W). 

It follows by calculation that 

E(r|Xi,...,x„) = /5„,(Xi + --- + x„), (11) 



where 



Likewise, 



l + p2(ri- 1) 



E{Y\X,,...,Xr„Z 

Z^n ) — Pn+m{^l + ■ ■ ■ + Xn + Zi + ■ ■ ■ + 

Zm) 

/E(r|Xi,...,X„) , E{Y\Z^,...,Z^) 



The result follows from the fact that Pn+m/ Pn = 'Jn/ln+m- ■ 



Corollary A. 2 The conditional probability density Pn{ ■ \ Y) of E(Y \ Xi, . . . , X„) given 
Y is almost surely Gaussian with conditional mean 

np^Y 



and with conditional variance 



l + p2(n-l) 



2_ V(l-p') , . 

" {l+p\n-l)f ^ ^ 
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Proof of Proposition 13. IL 

We use the conditional law of large numbers (LLN) to calculate the cross-sectional 
population density ft- Later, we independently calculate ft, given the appropriate bound- 
ary condition /o, by a direct solution of the particular dynamic equation that arises from 
updating beliefs at matching times. 

Taking the first, more abstract, approach, we fix a time t and state of the world 
u, and let Wn{uj) denote the set of all agents whose current precision is n. We note 
that Wn{uj) depends non-trivially on u. This set Wn{uj) has an infinite number of agents 
whenever /if(n) is non-zero, because the space of agents is non-atomic. In particular, 
the restriction of the measure on agents to Wn{uj) is non- atomic. Agent i from this set 
Wn{uj) has a current conditional mean of Y that is denoted Ui{uj). Now consider the 
cross-sectional distribution, qn{uj), a measure on the real line, of {Ui{uj) : i G Wn{uj)}. 
Note that the random variables Ui and Uj are F-conditionally independent for almost 
every distinct pair by the random matching model, which implies by induction in 

the number of their finitely many prior meetings that they have conditioned on distinct 
subsets of signals, and that the only source of correlation in Ui and Uj is the fact that 
each of these posteriors is a linear combination of Y and of other pairwise-independent 
variables that are also jointly independent of Y. 

Conditional on the event {Nu = n} that agent i is in the set Wn{uj), and conditional 
on Y, Ui has the Gaussian conditional density Pn{-\Y) recorded in Corollary IA.2[ This 
conditional density function does not depend on i. Thus, by a formal application of 
the law of large numbers, in almost every state of the world u, qn{^^) has the same 
distribution as the {Wn, F)-conditional distribution of U, for any i. Thus, for almost 
every u, the cross-sectional distribution g„(u;) of posteriors over the subset Wn{uj) of 
agents has the density Pn{- \ Y{uj)). In summary, for almost every state of the world, the 
fraction of the population that has received n signals has a cross-sectional density 

Pn{-\ Y{uj)) over their posteriors for Y. 

We found it instructive to consider a more concrete proof based on a computation of 
the solution of the appropriate differential equation for ft, using the LLN to set the initial 
condition /q. Lemma [A. II implies that when an agent with joint type {n,x) exchanges 
all information with an agent whose type is {m,y), both agents achieve posterior type 
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We therefore have the dynamic equation 

—ft{n,x) = r]{U{n,x) - ft{n,x)) + {ftoft){n,x)- Cnft{n,x)^ / ft{m,x)dx, 

™ 1 t/ M 



(13) 

where n(n, x) = Ti{n)pn{x \ ^(^)) and 

{ft° ft){n,x) = ^ — —Cn-mCm / ft(n-m,— —\ft{m,y)dy. 

jy^—l 1n-m J -oo \ In-m / 

It remains to solve this ODE for ft- We will use the following calculation. 



Lemma A. 3 Let qi{x) and q2{x) be the Gaussian densities with respective means 



Ml , M2 and variances o"^ , cr| . Then, 



qi I ) q2{y) dy = 

In—m J —00 \ In—m J 

where q{x) is the density of a Gaussian with mean 

M1n—m , 1m 
= /ii H Ai2 

and variance 2 2 

2 1n-m 2 I 7m 2 

(y = — —(^1 H — 2^2- 

In In 

Proof. Let X be a random variable with density qi{x) and Y an independent variable 
with density q2{x) . Then 

Z = In^ iln-rnX + 7™ F ) 

is also normal with mean M and variance cr^ . On the other hand, 7"^ 7n-m ^ and 
7~^ 7m Y are independent with densities 

7n / 7n 

gi X 



7n— "i \7n- 

and 

In ( In 
'~1m V7m 

respectively. Consequently, the density of Z is the convolution 



In f^°° I InX - ImV 



In—m J ~oo \ '~1n—m 

where we have made the transformation z = 7„ 7"-*^ y . ■ 
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qi , CTn-m q2{z) dz, (14) 



Lemma A. 4 The density 

ft{n,x,Lj) = fit{n)pn{x\Y{u)) 

solves the evolution equation f|T3|) if and only if the distribution fit of precisions solves 
the evolution equation ([1]). 

Proof. By Lemma IA.3I and Corollary IA.21 

Pn-ml— '^^\Y{uj)]pm{y\Y{Lj))dy 



'~in—m J —oo \ '~in—m / 

is conditionally Gaussian with mean 



7„ l + p^{n — m—l) 7„ l + p2(m — 1) l + p^{n—\) 
and conditional variance 



= ^T— ^ + -f ^2 



72 (l + p2(^_^_l))2 ^2 ^ (l + p2(^_l))2 (l + p2(^_l))2- 

Therefore, 

{ft o ft){n,x) 

n~l /'+00 / \ 

= ^ — ^C„_„C^ / ftin-m,— —\ft{m,y)dy 

jj^—l 1n-m J ~oo \ In-m / 

/it(n - m) fit{m) — — / p^-m — — Y{uj) Pmiy \ Y{uj)) 

j^—l 1n-m J -00 V 1n-m J 

n-1 

= ^ Cr^-rnCrn^t{n-m)flt{m)pn{x\Y{u))). 
m=l 

Substituting the last identity into ( fT3l) . we get the required result. ■ 

B Proofs for Section 4: Stationary Distributions 

This appendix provides proofs of the results on the existence, stability, and monotonicity 
properties of the stationary cross-sectional precision measure /i. 
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B. l Existence of the stationary measure 

Proof of Lemma 14.11 If a positive, summable sequence {/i„} indeed solves (jlj), then, 
adding up the equations over ra, we get that /i(N) = 1, that is, fi is indeed a probabihty 
measure. Thus, it remains to show that the equation 

oo 

c = J2MC)Cn 

n=l 

has a unique solution. By construction, the function fikiC) is monotone decreasing in 

C , and 

k-l 

VP'kiC) = V^k + ^CiCk-ifii{C)fik-iiC) - CkJik{C)C. 

1=1 

Clearly, Jii{C) < vti < 1. Suppose that C > cu . Then, adding up the above identities, 
we get 

n k—1 k~l 

V l^k{C) < V + CH^CiJii - Cifii < 7]. 

k=l 1=1 1=1 

Hence, for C > ch have that 

oo 
k=l 

Consequently, the function 

oo 

f{C) = Y^CMC) 

k=l 

is strictly monotone decreasing in C and satisfies 

f{C) < C, C>CH. 

It may happen that /(x) = +oo for some Cmin ^ (0, C) . Otherwise, we set Cmin = . 
The function 

giC) = C - fiC) 

is continuous (by the monotone convergence theorem for infinite series (see, e.g., Yeh 

(2006), p. 168)) and strictly monotone increasing and satisfies (7 (Cmin) < and gi^cn) > 
. Hence, it has a unique zero. ■ 
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B.2 Stability of the stationary measure 



Proof of Proposition [4721 The ordinary differential equation for /ifc(t) can be written 
as 

oo fe— 1 

/ife = rjTTk - Vf^k - Ckfik^Cifii + CifiiCk^iUk-i. (15) 

i=l 1=1 

We will need a right to interchange infinite summation and differentiation. We will use 
the following known 

Lemma B.l Let gk{t) be functions such that 

9 kit) and ^ ^fc(O) 

k k 

converge for all t and 

k 

is locally bounded (in t). Then, gk{t) is differentiable and 

Y.9k{t)] = Y.9'ki.t)- 

We will also need 
Lemma B.2 Suppose that f solves 

f = -a{t)f + 

where a{t) > e > and 

lim = c. 

t->oo a{t) 

Then, 



and limf^oo f(t) = c. 

Proof. The formula for the solution is well known. By FHopital's rule, 

/* e/o «(«)'^« b{s)ds , e/o '^(^)'^^ b(t)ds 
lim — -I = lim = c. 

t^oo gio a(s)ds t^oo Q^-^-J a(s)ds 

■ 

The following proposition shows existence and uniqueness of the solution. 
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Proposition B.3 There exists a unique solution {/ifc(t)} to ( |T5l) and this solution sat- 
isfies 

oo 

Y^fikit) = 1 (16) 
k=i 

for all t > 0. 

Proof. Let /i(N) be the space of absolutely summable sequences {/ifc} with 

ii{/^fc}ii«i(N) = Yl i^^i- 

k=l 

Consider the mapping F : li{N) ^i(N) defined by 

oo fc— 1 

i=l 1=1 

Then, fll5l) takes the form ({/ifc})' = F{{fik}). A direct calculation shows that 

oo k—l 



k=l 



'Y^iCiaiCk-ittk-i — Cibi Ck-ibk~i] 
1=1 

oo k—l 



- S'^l^' ~ ^'1 l^'^-'l + \(^k~i-h-i\\bi\ 

k=l 1=1 

= c|(ll{«fc}llh(N) + ||{&fc}llii(N))||{afc-&fc}llii(N)- (17) 

Thus, 

\\F{{ak}) - F{{bk})\\i,(^N) < iv + 24(||{afc}||ii(N) + ||{&fc}||«i(N)) )\\{ak - bk}\\h{N), 

so F is locally Lipschitz continuous. By a standard existence result (Dieudonne (1960), 
Theorem 10.4.5), there exists a unique solution to f[T^ for t G [0, To) for some Tq > and 
this solution is locally bounded. Furthermore, [0,To) can be chosen to be the maximal 
existence interval, such that the solution {/ifc} cannot be continued further. It remains 
to show that Tq = +oo. Because, for any t e [0, Tq), 

ll({/^fe})'ll«i(N) = ||i^({/ife})||h(N) < V + VWMWhiN) + 24||{/ifc}||f^(pj) 

is locally bounded. Lemma [B. II implies that 

o \ ' oo / oo fc— 1 

Y 1^''] = Yi^'^'^ ~ ^1^'' ~ ^'^1^''^ ^^1^^ ~^ ^ '^""^ Ck-iUk-i 

.i=l J k=l \ i=l l=\ 
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and hence (|T6l) holds. We will now show that /ifc(t) > for all t G [0, Tq]. For = 1, we 
have 

oo 

n[ = Tj-Ki - ?7/ii - Ci/ii y^C^/Xj. 

Denote ai{t) = —r] — Ci Yl'iLi CiHi- Then, we have 

^\ = 7]'Ki + ai(t)/ii. 

Lemma lB.21 implies that /ii > for all t G [0,To). Suppose we know that fii > for 
I < k — 1. Then, 

oo k—1 

^'k = Zk{t) + ak{t)nk{t) , ak{t) = -Tj-Ck^Ci^ii , Zk{t) = Wk + '}2 CiHiCk-ifJ^k-i- 

i=l 1=1 

By the induction hypothesis, Zk(t) > and Lemma [B.2I implies that fik > 0. Thus, 

oo 

ll{/^fc}||«i(N) = ^f^k = 1, 
k=l 

SO the solution to (fT5|) is uniformly bounded on [0, Tq), and can therefore can be continued 
beyond Tq (Dieudonne (1960), Theorem 10.5.6). Since [0,To) is, by assumption, the 
maximal existence interval, we have Tq = +oo. ■ 

We now expand the solution /i in a special manner. Namely, denote 

Ch - Q = > 0. 

We can then rewrite the equation as 

oo k—1 

/ifc = r]7rk - iv + 4j)iJ^k + CHfkfJ'k + C'fc /ifc /i /ij + CiHiCk-ifik-i- (18) 

i=l 1=1 

Now, we will (formally) expand 

oo 

f^k = ^ f^kj{t), 
j=0 

where fiko does not depend on (the whole sequence) (/j) , fik i is linear in (the whole 
sequence) (/j) , fik 2 is quadratic in (/«) , and so on. The main idea is to expand so that 
all terms of the expansion are nonnegative. 

Later, we will prove that the expansion indeed converges and coincides with the 
unique solution to the evolution equation. 
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Substituting the expansion into the equation, we get 

fc-i 

/^fco = V^k - {r] + Ch) Hko + CiiJ,ioCk-iiJ.k-i,o, (19) 

1=1 

with the given initial conditions: /xa;o(0) = /Xfc(O) for all /c . Furthermore, 

oo k—l 

/^fci = - iv + Ch) ^J'kl + ch fkfi'ko + Ckfiko"^ fifJ'io + 2^ Ci^ioCk-ifik-1,1, (20) 

i=l 1=1 

and then 

j-l oo 

f^i ,j — l—m 

m=0 i=l 
k-1 j-l 

(21) 

i=l m=0 

with initial conditions fikj{0) = 0. Equations (l20l) - fl2Tl) are only well defined if /ijo exists 
for all t and the infinite series 

oo 

1=1 

converges for all t and all j. 

Thus, we can solve these linear ODEs with the help of Lemma IB.2I This is done 
through a recursive procedure. Namely, the equation for fii q is linear and we have 

oo 

1=1 

A comparison theorem for ODEs (Hartman (1982), Theorem 4.1, p. 26) immediately 
implies that fiio < /ii for all t. By definition, fiko solves 

/^fco = V^k - iv + cjj)iJ,ko + Zko, 

with 

k-l 

Zko = CifJ'ioCk~.ifik-i,o 
1=1 

depending on only those /i/ o with I < k . Since /ii o is nonnegative, it follows by in- 
duction that all equations for fiko have nonnegative inhomogeneities and hence fiko is 
nonnegative for each k. Suppose now that fj,io < ni for all / < /c — 1. Then, 

fe-l k-l 

Zko = CiixioCk-ifik-1,0 < Cifxi Ck-ifik-i, 
1=1 1=1 
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and ( |T8i) and the same comparison theorem imply fiko < /Wfc. Thus, /i^o < /Wfc for all k . 
It follows that the series 

k 

converges and therefore, equations fl20l) are well-defined. Let now 

TV 

(N) _ 

i=o 

Suppose that we have shown that fikj > for all k and all j < — 1 and that 

/if < /i. (22) 

for all /c. Equations fl20l) - fl2Tl) are again linear inhomogeneous and can be solved using 
Lemma IB.2I and the nonnegativity of fikN follows. Adding (fT9|l - (l2T|) and using the 
induction hypothesis (122|) . we get 

(A"')' 

oo k—l 

< V^k - {v + c]j)ij!f'' + cnfklJ'i^^ + Ck iJ^i^^ fi fii ^Ci^iCk-i^ik-i- (23) 

i=l 1=1 

The comparison theorem applied to (!23l) and (ITSl) implies that /if ^ < /i^. Thus, we 
have shown by induction that ^kj > and 

N 

for any A^ > 0. The infinite series Xljlo f^kj{t) consists of nonnegative terms and is uni- 
formly bounded from above. Therefore, it converges to a function jlk{t). Using Lemma 
IB. II and adding up (fT^ - (l?Ii) . we get that the sequence {fik{t)} is continuously differen- 
tiable and satisfies flTH]) and /ifc(O) = /ifc(O). Since, by Proposition IB. 31 the solution to 
(fTS]) is unique, we get fik = /^fc for all k. Thus, we have proved 

Theorem B.4 We have 

oo 

/ifc = ^ /ifcj- 
i=o 

It remains to prove that limj^oo /ifc(^) exists. The strategy for this consists of two 

steps: 
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1. Prove that limj^oo f^kj(t) = fikj{oo) exists. 

2. Prove that 

oo oo 

hm "S^ fikj = hm ^kj- 

j=0 j=0 

Equation (HM and Lemma [R2] directly imply the convergence of /x^o • But, the next step 
is tricky because of the appearance of the infinite sums 

oo 

in equations (120!) - (12T!) . If we prove convergence of this infinite sum, a subsequent ap- 
plication of Lemma lB.21 to fl20l) - fl2Tl) will imply convergence of fiij+i. Unfortunately, 
convergence of fJ^ijit) for each i,j is not enough for the convergence of the infinite sum. 

Recall that, by assumption, there exists an such that Ci = Cn for all i > N. 
Thus, we need only show that 

oo 

i=N 

converges for each j . 

We will start with the case j = 0. Then, adding up (fT9l) and using Lemma [B. 11 we 

get 

^oW + Y.^''^o = V - iv + cl) [ Mo{t) + ^ ;x,o I + ( 5^ a/i,o + C^Mo(t) 

i=l \ i=l / \ i=l 

Opening the brackets, we can rewrite this equation as a Riccati equation for Mq : 

M^{t) = ao{t) +bo{t)Mo{t) + ClM^{tf. 



A priori, we know that Mq stays bounded and, by the above, the coefficients oq , &o 
converge to finite limits. 

Lemma B.5 Mo(t) converges to a finite limit at t ^ oo. 

To prove it, we will need an auxiliary 
Lemma B.6 Let N{t) be the solution to 

N'{t) = a + bN{t) + cN^{t) , N{0) = Nq. 
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// the characteristic polynomial q{X) = a + bX + cA^ has real zeros Ai > A2 then 

(1) If No < Ai then lim^^oo iV(t) = A2. 

(2) If No > Ai then \imt-.ocN{t) = +00. 

If q{X) does not have real zeros, then limt^oo N{t) = +00 for any Nq. 

Proof. The stationary solutions are = Ai^2- If ^0 < -^2 then N{t) < X2 for all t by 
uniqueness. Hence, N'{t) = a + bN(t) + cN'^(t) > and N{t) increases and converges 
to a limit A^(oo) < A2. This limit should be a stationary solution, that is A^(oo) = A2. If 
-^0 ^ (-^25 Ai) then N{t) G (A2,Ai) for all t by uniqueness and therefore N'(t) < and 
N{t) decreases to A^(oo) > A2, and we again should have iV(oo) = A2. If A^o > -^i; N' > 
and hence 



for all t and the claim follows. If q{X) has no real zeros, its minimum minA6Rq'(A) = 6 
is strictly positive. Hence, N' (t) > 6 > and the claim follows. ■ 

Proof of Lemma IB. 51 Consider the quadratic polynomial 



We will consider three cases: 

1- Q'oo(A) does not have real zeros, that is, miuAeR QooiX) = 5 > 0. Then, for all 
sufficiently large t, 



so Mo{t) will converge to +00, which is impossible. 

2. qoo{X) has a double zero Aoo- Then, we claim that limj_>oo (t) = Aoo- Indeed, 
suppose it is not true. Then, there exists an e > such that either snpiyrp{M{t) — 
Aoo) > £ for any T > or supj>j.(Aoo — M(t)) > e for any T > 0. Suppose that the 
ffist case takes place. Pick a 5 > and choose T > so large that 

ao(t) > ao(oo) — 5, boif) > bo{oo) — 6 

for all t > T. The quadratic polynomial 

ao{oo)-6 + (60(00) - (5) A + C^A^ 



N\t) 



a + bN{t) + cN^{t) > a + bNo + cN^ > 



qoo{X) = ao(oo) + feo(oo)A + C^A^ = 0. 



M^(t) = ao{t) +bo{t)Mo{t) + ClMo{tf > 5/2 > 0, 



(24) 
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has two real zeros > \2{S) and, for sufficiently small 5, |Ai,2(5) — Aoo| < e/2. 

Let To > T be such that Mq(To) > Aoo + £■ Consider the solution N(t) to 

N'{t) = ao{oo)-6 + (boioo)- 6) N{t) + CljN{t)\ N{To) = M{To) > Xi{6). 

By the comparison theorem for ODEs, Mo(t) > N{t) for all t > Tq and Lemma[R6] 
implies that N(t) oo, which is impossible. Suppose now sup(>2"(Aoo — M(t)) > e 
for any T > 0. Consider the same N{t) as above and choose 5 so small that M(To) < 
\2{8). Then, M{t) > N{t) and, by Lemma EH N{t) X2{6). For sufficiently 
small S, X2{S) can be made arbitrarily close to 6oo and hence sup^y^{\oo — M{t)) > e 
cannot hold for sufficiently large T, which is a contradiction. 

3. g(A) has two distinct real zeros Ai(oo) > A2(oo). Then, we claim that either 
limj^oo ^(^) = Ai(oo) or lim^^oo ^(^) = A2(c)o). Suppose the contrary. Then, 
there exists an e > such that sup^^^ l^(^) ~ Ai(oo)| > e and sup^^^ l^(^) ~ 
A2(oo)| > £. Now, an argument completely analogous to that of case (2) applies. 

■ 

With this result, we go directly to (!20|) and get the convergence of /ij i from Lemma 
El Then, adding equations ([20]), we get a linear equation for Mi(t) and again get 
convergence from Lemma IB.2I Note that we are in an even simpler situation of linear 
equations. Proceeding inductively, we arrive at 

Proposition B.7 The limit 

lim ^lkj{t) < 1 

exists for any k,j . 

The next important observation is: If we add an e to c in the second quadratic 
term, and subtract e from c in the ffist quadratic term, then the measure remains 
bounded. This is a non-trivial issue, since the derivative could become large. 

Lemma B.8 If e is sufficiently small, then there exists a constant K > such that 
the system 

oo k—l 

f^'k = VT^k - Vf^k - (Ck- e) fik^iCi- e) fli + ^ Ci niCk-i fik-i 

i=l 1=1 
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has a unique solution {/ife(t)} G /i(N) and this solution satisfies 

oo 

fc=l 

/or a// t > . 

Proof. An argument completely analogous to that in the proof of Proposition IB.3I 
implies that the solution exists on an interval [0,To), is unique and nonnegative. Letting 

oo 
k=l 

and adding up the equations, we get 

M' < 7] - TjM + 2ecHM'^ . 

Consider now the solution to the equation 

N' = 7] - r]N -\- 2ecHN^. (25) 

By a standard comparison theorem for ODEs (Hartman (1982), Theorem 4.1, p. 26), if 
iV(0) = M(0), then M{t) < N{t) for all t. Thus, we only need to show that N{t) 
stays bounded. The stationary points of (!25|) are 



di' 



Aech 

so, for sufficiently small e , the larger stationary point di is arbitrarily large. Therefore, 
by uniqueness, if A^(0) < di , then N{t) < di for all t, and we are done. Now, the 
same argument as in the proof of Proposition IB. 31 implies that Tq = +oo and the proof 
is complete. ■ 

Since (/j) is bounded, for any e > there exists a, S > such that 

f^ + e > (1 + 5)/. 

for all i . Consider now the solution (/x^"^^) to the equation of Lemma [B.8I Then, using 
the same expansion 



j=0 

we immediately get (by direct calculation) that 
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By Lemma IB.81 



K 



and therefore 

for some (possibly very large) constant K, independent of t . Now we are ready to prove 



Theorem B.9 We have 



Proof. Take so large that 



lim /ifc(t) = /ifcj(oo). 

t— »oo ' 

i=o 



K 



j=N j=N 

for all t . Then, choose T so large that 

N-l 



i=o 



for all t > T . Then, 



j=0 

Since e is arbitrary, we are done. ■ 



Lemma B.IO Consider the limit 

C = lim Cn^nit)- 

n 

In general, 



< e. 



with equality if and only if 



C> Vahm/i„(t) = C 



Furthermore, 



C - C = Cn \ l - lim/i„(t) I 

\ n J 
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Based on this lemma, we have 
Lemma B.ll The limit ^ao{n) = \im.t-,oo fJ'ti'f^) satisfies the equation 

= r/(7r - ^oo) + fiZ*fJ'Z - f^ZC, 

where, in general, 
and 

/ioo(N) = 1 - v^'f^ZiC - fig) < 1. 

An immediate consequence is 

Lemma B.12 The limit distribution fi^o is a probability measure and coincides with the 
unique solution to (jl]) if and only if C = C. 

Proposition B.13 Under the same tail condition Cn = forn > N and the condition 
that 

V > CnCh, (26) 

we have 

C = C, 

and, therefore, fi^o is a probability measure that coincides with the unique solution to (jl]). 

Proof. Recall that the equation for the limit measure is 

-r]Hoo{k) + r]T^k-CCkfioo{k) + '^Cifi^{l)Ck-ilioo{k-l)=0, (27) 

where 



C = lim C„/i„(t) >y^Cnfioo{n) = C. 

n n 

The difference, 

C - C = {1-M)Cn, 

with 

M = 5^/ioo(A;), 

k 

is non-zero if and only if there is a loss of mass, that is M < 1. 
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Adding ( 1271) up over k , we get 

-riM + -CC + {Cf = 

= -T] M + r] - C {C - {1 - M) Cn) + {C ~ {1 - M) Cn?- (28) 

If M 7^ 1, we get, dividing this equation by (1 — M) , that 

V - CnC 
M = 1 + . 

Since M < 1 , we immediately get that if 

then there is no loss of mass, proving the result. ■ 

B.3 Monotonicity properties of the stationary measure. 

We recall that the equation for the stationary measure /i = {fik , k > 1) is 

oo k—l 
i=l 1=1 

We write {/ifc(C,Ci, . . . ,Ck) '■ k > 1} for the measure constructed recursively in 
the statement of Lemma 14.11 from a given C and a given policy C. 

Lemma B.14 For each k , the function that maps C to 

Ckfik = CkfikiC , Ci , . . . , Ck) 

is monotone increasing in Ci , i = 1 , . . . , k , and monotone decreasing in C . 

Proof. The proof is by induction. For k = 1, there is nothing to prove. For k > 1, 

Ck ( ^"^ 
V + ^^k \ 

is monotone, by the induction hypothesis. ■ 
Steps toward a proof of Proposition 14.31 
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Our proof of Proposition 14.31 is based on the next series of results, Lemmas IB.15I 
through IB.261 for which we use the notation 



— J^k{Ci , . . . , Ck , C) — Ck fik{C,Ci, . . . ,Ck) 

and 



V + CkC 

Note that, multiplying y/f] and Ck by the same number A does not change the equation, 
and hence does not change the stationary measure. Thus, without loss of generality, we 
can normalize for simplicity to the case 77 = 1 . 

Lemma B.15 The sequence Vk satisfies 

Ui = ZiTli, 

^k = Zk i^k + ^« ^k-^ , 

and 

00 

J2MCi, ... ,Ck,C) = C. (29) 

k=l 

Differentiating (129!) with respect to C^, we get 



Lemma B.16 



Fir ^ 



dCk 1 - E.=i %' 

We now let C{C) denote the unique solution of the equation ( 1291) . and for any 
policy C we define 

UC) = i^fc(Ci,...,C,,C'(C)). 



Lemma B.17 Let m < k . We have 

d 



dC„ 

if and only if 



^-ES E-.^.||^ E-.i||)E(-|^). (30) 

1 — -i- / % — K \ — -L 
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Proof. We have 

d ^ ^ / dvi dvi dC 

i=k i=k 



/i _ v^oo dui\ v^oo dvj _|_ v^oo duj^ ( v^fc— 1 , v^oo \ 
V Z^i=l dC ) 2^i=k dCm 2^i=k dC \2-^i=m Z^i=kJ 



CO \ dvi 



acr, 



1 _ dui_ 
^ Z^i=l dC 

4=1 dc / Z^i=fc ac.„ "t" l^i=k ac ^ 



dC J ^i=k dCm ^i=k dC ^i=m dCm 

~ 1 _ ^ ' 

and the claim follows. ■ 

Suppose now that we have the "flat-tail" condition that for some N, Cn = Cn 
for all n > . We define the moment-generating function m( ■ ) of by 



) = E'^^^^- (31) 



i=l 



By definition, the first A^ — 1 coefficients z/j of the power series expansion of m(x) satisfy 



and then 



for i < N — 1 , and 



l^i = I TTj + 

1=1 



for z > iV . For > 2 , let 

oo 

m\x,N) = 7iix\ 

i=N 

Using Lemma IB. 151 and comparing the coefficients in the powers-series expansions, we 
get 

Lemma B.18 If = Cm for all n > N , then 

m{x) — ViX^ = Zm I m!'{x,N) + m^(x) — x* i^ii^i-i 

i=l \ 1=2 1=1 
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Thus, 

(N~l i-1 \ N-1 

m^{x,N) + w?{x) - 2:* ^ vi^i^i I - m{x) + Vjx' 
i=2 1=1 / i=l 

(N~l i~l 
m\x,N) + m^{x) - J2 Yl "^"^^^ 
i=2 1=1 

N-1 / i-1 \ 

- m{x) + TTiZiX + ^ Z, i-Ki + ^ ui Ui_i I x' 

i=2 \ 1=1 J 

(N-1 N-1 / i-1 

m!'{x,N) + ^ TTjX* - ^ I TTj + ^ l^ll^i-l I x'^ 

i=2 i=2 \ 1=1 
N-1 / i-1 \ 

+ TTiZiX + ^ Zi VTi + ^ l^l l^i-l I 
i=2 \ i=l / 

= ZNTn^{x) — m{x) + Zj^m''{x,2) + i{\Z\x 

N-1 / i-1 

+ ^ X* {Zi - Zn) i-rri + ^iyi Vi-i 
i=2 \ 1=1 

Solving this quadratic equation for m(x) and picking the branch that satisfies m(0) = 0, 
we arrive at 

Lemma B.19 The moment generating function m( ■ ) of u is given by 



™W ^ 1- V™^ . (32) 

where 

N-1 / i-1 

M{x) = ZNm^{x,2) + TTiZix + ^ x' {Zi - Zn) I + ^ i^ii^i-i 

1=2 \ 1=1 



The derivatives of the functions Zk satisfy interesting algebraic identities, sum- 
marized in 

Lemma B.20 We have Z^ < 1 for all k. Moreover, 

2 dZf: _ dZk _ 2 

^^acv " 'dc ~ 
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These identities allow us to calculate derivatives is an elegant form. Let 

7(x) = (1 - 4Z^C(a:))-^/^ 

with 

N-l / i-l \ 

Cix) = ZNm\x,2) + mZ^x + ^'(Z, - Zn) + ■ (33) 

i=2 \ 1=1 J 

Differentiating identity (!32|) with respect to C and Cn-i and using Lemma [B.20t we 
arrive at 

Lemma B.21 We have 

N~l / i-l 



\ i=l V 1=1 



1^1 l^i-l 



N-l _o i-l \ 

+ E^*(^^ - Zn)^J2''^''^-i (34) 

i=2 1=1 J 

and 

^'^^'"^ - l{x) x^"^ Zl_, L^., + E ^^-1-^) • (35) 



Let now 



(=1 



7(a;) = E 7j^^' (3^) 
i=o 

and let 7j = for j < . 

Lemma B.22 M^e /ia^ie 7j > for all j . 

Proof. By f l33|) . the function C( ' ) has nonnegative Taylor coefficients. Thus, it suffices 
to show that the function that maps x to (1 — x)~^/^ has nonnegative Taylor coefficients. 
We have 

oo 

{l-x)-'" = 1 + E^'/^'^' 

k=l 

with 



= (-1) 



V-0.5)(-0.5 - l)(-0.5 - 2) ■ ■ ■ (-0.5 - A; + i; 



k\ 

(0.5)(0.5 + 1)(0.5 + 2) ■ ■ ■ (0.5 + A; - 1) 

k\ ^ 
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Therefore, 

oo 

7(x) = 1 + ^ (4Z^C(a;))' 

k=l 

also has nonnegative Taylor coefficients. ■ 
Let 

7V-2 
1=1 

Define also 
and 

n *— 1 
-a 



i?i = {Zi - Zn) T^^^l 



Recall that Zi > Zj^ if and only if Cj > Cjv and therefore, -Rj > for all i as soon 
as Ci > Cjv for alH < iV - 1 . 



Lemma B.23 We have 



Z AT-l Qn-1 Ij-N+l 



and 

^ - \^ R - ^-1 p aVj^i+N- l 

j=0 i=0 



Proof. Identity (134|) implies that 

— (9m(x) 



On the other hand, by (ETl) . 



oo TV-l 
j=l i=0 



—dm{x) X ^ ^. — (9z/j 

Comparing Taylor coefficients in the above identities, we get the required result. The 
case of the derivative d/dCN-i is analogous. ■ 

Lemma B.24 We have 

oo oo Qi/. 

{Ro + ■■■ + Rn-i) Qn\ ^ ^ > ^ -~- 

j=k ~^ j=k 
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and 



1=1 j=l 



Proof. By Lemma IB. 231 



oo N-1 



= EE 

j=k j=k j=0 

7V-1 oo 

= E «- E ■» 

i=0 j=k—i 
N-1 oo 

E«- E % 

i=0 j=k-N+l 



< 



oo 

{Rq + ■ ■ ■ + Rn-i) Qn-1 ^ ^ 



■ , dCN-1 

j=k 



and 



k-l o k-1 N-1 



j=l j=l i=0 



k-l N-1 k-l-i 

= Ro XI 7i + J2 ^ 

i=0 1=1 j=0 

k-N+1 

> {Ro + ■■■ + Rn-i) Y1 

j=0 

k-l 

= (Ro + ■■■ + Rn-i) Zj^\Qj^\ ^ ^ 



. , dC^-i 
■ 

By definition, Rq = 1/2 and 70 = 1 . Hence, we get 

Lemma B.25 Suppose that Ci > Cn for all i < N and Ci = Cn for all i > N . 
Then, for all m > N , 

m—l r% \ 00 r% m— 1 CO 

^ dC OCm-i - . 9'^N-i dC • 

1=1 / A;=m 1=^—1 k=m 

Lemma B.26 The function A defined by 

00 

i=n 

is monotone increasing in Ck for all k > n . 
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Proof. By Proposition 14.41 

oo 

Xi = C = Y.^. 

i=l 

is monotone increasing in Ck for each k . By Lemma 14.11 and Proposition 14. 4[ = 
fii{Ci, . . . , Ci_i, C) is monotone decreasing in for all k > i . Thus, 

n-l 

= C — 6 

i=l 

is monotone increasing in . ■ 

We are now ready to prove Proposition 14. 3[ 

Proof of Proposition 14.31 It suffices to prove the claim for the case = M + 1 . 
It is known that /i*^'^ dominates /i^'*^ is the sense of ffist order stochastic dominance 
if and only if 

oo oo 
i=k i=k 

for any k > 1 . The only difference between policies and (7^^+^ is that 

^M+i _ „ ^ „ _ 

By Lemma IB.26[ flTTI) holds for any k < M . By Lemmas IB. 171 and IB.25[ this is also 
true for k > M . The proof of Proposition 14.31 is complete. ■ 

Proof of Proposition 14.41 By Lemma IB.14t the function / that maps {C, C) to 

oo 

>1)) = EC'fc/i;^(^,C'i,--- ^c*;^) 

k=l 

is monotone increasing in Ci and decreasing in C . Therefore, given C, the unique 
solution C to the equation 

C - fiC, > 1)) = (38) 

is monotone increasing in Ci for alH. ■ 

Proof of Example 14.51 of non-monotonicity 

Let Cn = for n > 3 , as stipulated. We will check the condition 

du2 



dCi 
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> 0. 



By the above, we need to check that 



> 



dC J da 



dCi dC ■ 



We have 



Pi = niZi 



and 



Since z/j = for i >2 , using the properties of the function Zk, the inequahty takes the 
form 

(1 + 7riZ2)Cf'7ri7ri2Zf Z2 > C^^ Zf [iiiZl + vn vn 2 + {mZif Zl) . 

Opening the brackets, 



Consider the case Ci = C2 in which Z\ = Z2- Then, the inequahty takes the form 

2 7ri > TTa + (vriZi)^ 

If 1x2 > 2 7ri, this cannot hold. 

C Proofs for Section [5], Optimality 

Proof of Lemma 15.11 

Let (j) be any search-effort process, and let 



Jo 

By Ito's Formula and the fact that V solves the HJB equation ([6]), 6''^ is a super- 
martingale, so 



For the special case of = r{Nt), where N satisfies the stochastic differential 
equation associated with the specified search-effort policy function F, the HJB equation 
implies that 6* = 9'^'* is actually a martingale. Thus, 



t:iTIi2ZIZ2 > tixZ\ (ttsZ^ + (ttiZO^Z^). 




(39) 



V{N,o) = 9; = E{9*) = 



It follows from fl39|) that U{(f)*) > U{(f)) for any control (p. ■ 
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Lemma C.l The operator M : ioo ^ '^oo , defined by 

(MV)^ = max ( v'^in) ' m ^ c f^y^^^c^^c \ (40) 

c \ cC + r + 7]' cC + r + 7]' j 

is a contraction, satisfying, for candidate value functions Vi and V2, 

ChC + r + 7]' 

In addition, M is monotonicity preserving. 

Proof. The fact that M preserves monotonicity follows because the pointwise maximum 
of two monotone increasing functions is also monotone. Now we provide the contraction 
argument. Let 

7l'u{n) - K{c) c ^ c 

m=l 

Let 

MVi{n) = M,,Vi{n) 

and 

MV2{n) = MMn), 
and assume without loss of generality that MVi{n) < MV2{n) . Then, 

< MV2{n) - MVi{n) 
= MMn)- M,,Vi{n) 

< M,^V2{n)- M,^V,{n) 

00 

^2 V^/T/ n ..C 



n+m C*m l-^r, 



C2C + r + ?7' ^ 

' m=l 

and the estimate immediately follows. ■ 

The contraction mapping theorem implies the 

Corollary C.2 The value function V is the unique fixed point of M and is a monotone 
increasing function. 

Lemma C.3 Let 

C = {V & ioc '■ Vn — (r + 7]')~^ T]' Un is monotonc decreasing}. 

If u{-) is concave, then the operator M maps C into itself. Consequently, the unique 
fixed point of M also belongs to C . 
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Proof. Suppose that V ^ L . Using the identity 

u{n) u{n) u{n) cC 



cC + r + r]' r + 7]' r + rj' cC + r + r]' ' 

we get 

V'Un 



r + rj' 

jun - K{c) c ^ c 

cC + r + ?7 cC + r + 71 ^ — ^ 

' ' m=l 

-K{c) C A/ V'Un+m. , V'Un+m - ^r, 



+ ^ , ; 7 / , I ^n+m ~ 

cC + r + ri' ^-^ \ r 



cC + r + ri' cC + r + ri' ^ \ r + ri' r + n' 

' ' m=l ^ 

Since V E C and u is concave, the sequences 



C 



Cm /i. 



Dn = E "^^^^ - ^ + " "/ ^"-/^^ (42) 



m=l 



oo 



Ev;.^^../^^, - ^ (43) 



m=l 



and 



m=l 

oo 



5n = E ( - + ) Cm/i^ (44) 



— Vn+mCm fJ'm ~ ; T (45) 

z — / r + r?' 

m=l ' 

are monotone decreasing. Since the maximum of decreasing sequences is again decreas- 
ing, the sequence 

(MV)^ - J]^ = max(M,y)„ - ^ 
r + rj' c r + r) 

is decreasing, proving the result. ■ 

We will need the following auxiliary 

Lemma C.4 If K{c) is a convex differentiable function, then c ^ K{c) — K'{c)c is 
monotone decreasing for c > . 

Proof. For any c and b in [cl,Ch] with c > b, using first the convexity property that 
K{c) — K{b) < K'{c){c — b) and then the fact that the derivative of a convex function is 
an increasing function, we have 

{K{c) - K\c) c) - {K{b) - K'{b)b) < K\c){c - b) - K\c)c + K'{b)b 

= b{K'{b) - K\c)) < 0, 
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the desired result. ■ 



Proposition C.5 Suppose that the search cost function K is convex, dijferentiable, and 
increasing. Given {fi,C), any optimal search-effort policy function r(-) is monotone 
decreasing. If K{c) = no for some n > 0, then there is an optimal policy of the trigger 
form. 



Proof. The optimal V solves the alternative Bellman equation 



Vri = max 



Kic) 



cC + r + 77' cC + r + Tf 



C 



(46) 



?n=l 



We want to solve 



with 



max /(c) = max 



rj'u{n) + cYn — K{c) 



cC + r + rj' 

00 



C 



m=l 



Then, 



(y„(r + r/') -iu{n)C) + C {K{c) - K'{c)c) - {r + r]')K'{c) 



{cC + r + T]')^ 

By Lemma [C.4t the function K{c) — K'{c) c is monotone decreasing and the function 
— (r + f]') K'{c) is decreasing because K{ ■ ) is convex. Therefore, the function 

C{K{c) - K\c)c) - {r + r]')K'{c) 

is also monotone decreasing. There are three possibilities. If the unique solution Zn to 

C{K{zn) - K'{zn)z.,) - {r + ri')K'{zn) + (K„(r + V) -7]'u{n)C) = 

belongs to the interval [c^, c//], then /'(c) is positive for c < z„ and is negative for c > z„ . 
Therefore, /(c) attains its global maximum at Zn and the optimum is Cn = Zn ■ If 

C{K{c) - K\c)c) - {r + r]')K'{c) + (F„(r + V) -v'u{n)C) > 

for all c G [cl, Ch] then /'(c) > 0, so / is increasing and the optimum is c = Ch ■ 
Finally, if 

C{K{c) - K\c)c) - {r + r]')K'{c) + (F„(r + r/') -r]'u{n)C) < 
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for all c G [cl.Ch] then /'(c) < 0, so / is decreasing and the optimum is c = Cl . By 
(jSj), the sequence 

y-air + 'T]') - Cri'u{n) = {r + rj') Bn 

is monotone decreasing. The above analysis directly implies that the optimal policy is 
then also decreasing. 

If K is linear, it follows from the above that the optimum is ch if Yn{r + rj') — 
C Tj' u{n) > and cl if Yn{r + rj') — C rj' u{n) < . Thus, we have a trigger policy. ■ 

Proof of Proposition 15.31 Using the fact that 



oo 



{r + lf]')Vn = sup lf]'Un-K{c) + C ^ (K+m - K)Cm/Um, 
c&[cl,ch] rn=l 

which is a concave maximization problem over a convex set, the supremum is achieved 
at Cl if and only if some element of the supergradient of the objective function at cl 
includes zero or a negative number. (See Rockafellar (1970).) This is the case provided 
that 

oo 
m=l 

where K'{cl). By Lemma [C. 31 

oo oo 

^ (K+m - Vn)Cm f^m < ^ {r + If]') ^ ( 

m=l 

oo 

< ri\r + rj') ^{u- Un)Cm 

m=l 

< K'{cl), for n >N, 



m=l m=l 

oo 



completing the proof. ■ 

D Proofs for Section 6: Equilibrium 

This appendix contains proofs of the results in Section 6. 

D.l Monotonicity of the Value Function in Other Agents' Trigger Level 

From the results of the Section [5l we can restrict attention to equilibria in the form of 
a trigger policy C^, with trigger precision level N. For any constant c in [cl^ch]-, we 
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define the operator , at any bounded increasing sequence by 

if oo 



N 

m { ' 



m=l 



where 

oo 
i=l 

Lemma D.l Given (/i^,C^) , the value function of any given agent solves 

C= sup {LfC}- 

Lemma D.2 The operator is monotone increasing in N . That is, for any increasing 
sequence g , 

Proof. It is enough to show that if f{n) and g{n) are increasing, bounded functions 
with /(n) > g{n) > , then L^~^^f{n) > g{n). For that it suffices to show that 



m=l 

oo 

>{cl-cC'')g{n) + cJ29{n + m)C^f^Z- (47) 

m=l 

Because / and g are increasing and f > g, inequahty fj47|) holds because 

oo oo 

N+1 > r^n^ 

m=k m=k 

for all A; > 1, based on Proposition 14.31 ■ 

Proposition D.3 // A^' > N, then V^\n) > V^{n) for all n. 

Proof. Let 

L^'V = sup L^V. 

c e [ci , ch] 

By Lemmas EI] and [ES 
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Thus, for any c G [c^ , Cr] , 

oo 

rt'u{n) - K{c) + (4 - cC'^)V^^'H + c ^ ^^'(n + m)c^;x^ 

m=l 

Multiplying this inequality by cjj + rj + r , adding {C^ c — cj^) V^' (n) , dividing by 
cC^ + r + 7] , and maximizing over c , we get 

where the M operator is defined in Lemma \C1\ corresponding to . Since M is 
monotone, we get 

yN' > ^kyN' 

for any G N . By Lemma IC.ll and Corollary \(J.2\ 

lim M'^y^' = y^, 

and the proof is complete. ■ 

D.2 Nash Equilibria 

We define the operator Q : ^oo — ^ ^oo by 

(Q(7)(n) =argmax N^^^) - ^^f) + r ' , E {n + m) {m\ 
c \ Cc + r + 1]' Cc + r + 1]' j 

where 

V'{n) = max h'<^) -K{c) ^ ' V^{n + m)^^im) ]. 

c \ Cc + r + r]' Cc + r + 1]' j 

We then define the MiN) C N as 

M{N) = {nGN;C"G 

The following proposition is a direct consequence of Proposition 15.41 and the defi- 
nition of the correspondence M . 

Proposition D.4 Symmetric 'pure strategy Nash equilibria of the game are given by 
trigger policies with trigger precision levels that are the fixed points of the correspondence 

N. 



1 

c% + 7]' + r 
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Lemma D.5 The correspondence f/{N) is monotone increasing in N. 
Proof. From the Hamilton- Jacobi-Bellman equation ([6]), 



m=l 



Let first cl > . Then, it is optimal for an agent to choose c = ch if 

oo 

- + E - ^n) C^^f^Z > ^ (r + - ^'^n > 0, (48) 

■m=l 

the agent is indifferent between choosing ch or cl if 

oo 

- + E - ^n) C^^f^l = ^ (r + r/')K^ - ^'^n = 0, (49) 

m=l 

and the agent will choose cl if the inequality < holds in (1481) . By Lemma [C.31 the set 
of n for which (r + 1]') — rj'un = is either empty or is an interval Ni < n < N2. 
Proposition ID. 31 implies the required monotonicity. 

Let now cl = 0. Then, by the same reasoning, it is optimal for an agent to choose 
c = Ch if and only if (r + 77') — rj'un > 0. Alternatively, (r + 77') — ri'un = 0. 
By Lemma IC.31 the set n for which (r + 77') Vj^ — rj'un > is an interval n < Ni 
and hence (r + 77') Vj^ — rj'un = for all n > Ni. Consequently, since Un is monotone 
increasing and concave, the sequence 



Zn '■— — 1^ + E ^n+m ~ f^m — ~ 1^ + ^ ^ , ^ i'^n+m — «„) /i^ 

m=l m=l 

is decreasing for n > Ni. Therefore, the set of n for which Z„ = is either empty or is 
an interval Ni < n < A^2- Proposition 14.31 implies the required monotonicity. ■ 

Proposition D.6 The correspondence M has at least one fixed point. Any fixed point 
is less than or equal to N . 

Proof. If G A/'(0), we are done. Otherwise, inf{A/'(0)} > 1 . By monotonicity, 
inf{A/'(l) } > 1. Again, if 1 G A/'(l), we are done. Otherwise, continue inductively. 
Since there is only a finite number of possible outcomes, we must arrive at some n 
m.N'{n). ■ 

Proof of Proposition 16.41 The result follows directly from Proposition ID. 31 and the 
definition of equilibrium. ■ 
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D.3 Equilibria with minimal search intensity 
Lemma D.7 The operator A is a contraction on i^o with 

r + rj' + cj^ 

Furthermore, A preserves positivity, monotonicity , and concavity. 

Proof of Lemma 16.51 We have, for any bounded sequence g, 

(? °° (? 

- r + ^ ^ r2 \3n^rn\\l^ < ^.J.o ^^V9n, (50) 

which establishes the first claim. Furthermore, if g is increasing, we have gm+m ^ 
gn2+m for ni > n2 , and for any m . Summing up these inequalities, we get the required 
monotonicity. Preservation of concavity is proved similarly. ■ 

Proof of Theorem 16.61 It suffices to show that, taking the minimal- search C°) 
behavior as given, the minimal-effort search effort Cl achieves the supremum defined by 
the Hamilton- Jacobi-Bellman equation, at each precision n, if and only if K'{cl) > B, 
where B is defined by ([8]). 

By the previous lemma, V{n) is concave in n. Thus, the sequence 



m=l 

is monotone decreasing with n . Therefore, 

oo oo 

V {Vi+m - Vi) = max V (K+m - K) /^l^- 

' n ' 

m=l m=l 

We need to show that the objective function, mapping c to 

oo 

-K{c) + CCl ^(K+m - 
m=l 

achieves its maximum at c = . Because K is convex, this objective function is 
decreasing on [cl , ch] , and the claim follows. ■ 

The following lemma follows directly from the proof of Proposition ID. 61 

Lemma D.8 If G Q{C^) for some N >1 then the correspondence Af has a fixed 
point n > 1 . 
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Proof of Proposition [6771 By the above lemma, it suffices to show that Q(C^) 7^ C° . 
Suppose on the contrary that Q{C^) = C° . Then the value function is simply 



r + rj' 

It follows from (HHjl that Ci = is optimal if and only if 



r + rj' 



m=l 



By ( HHl) . we will have the inequality > for all > 2 and a strict inequality 
Vi > Vi, which is a contradiction. The proof is complete. ■ 

E Proofs of Results in Section [7], Policy Interventions 

Proof of Lemma 17.11 By construction, the value function associated with pro- 
portional search subsidy rate 6 is monotone increasing in 6 . By f HHjl . the optimal trigger 
is that n at which the sequence 

crosses zero. Hence, the optimal trigger is also monotone increasing in 6 . ■ 

Proof of Lemma 17.31 Letting Vn,M denote the value associated with n private signals 
and M public signals, we define 

7 V'Un+M 
^n.M — Vn,M — ; 7- 

r + 7]' 

We can rewrite the HJB equation for the agent, educated with M signals at birth, in the 
form 

(oo 
+ ^ {Vn+m,M - K,m) fJ'm 
m=l 



sup C j Wn,M - 1^ + ^ {Zn+m,M - Z^m) /i 



oo 

C 

m \ ' 

m=l 



where 

, oo 

Wn,M = ; 7 / ^ {Un+M+m — ^n+A/) A'm- 

r + r? ^-^ 

m=l 
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The quantity Wn,M is monotone decreasing with M and n by the concavity of u{ 
Equivalently, 



Zn,M = sup — ( Wn,M " + ^n+m,A/ /^^ 1 • (51) 

ce[cL,c„] Cc + r + T]' \ ^ I 



m=l 



Treating the right-hand side as the image of an operator at Z, this operator is a con- 
traction and, by Lemma [0.21 Zn,M is its unique fixed point. Since Wn,M decreases with 
M, so does Zn,M ■ 

By Lemma fCSl Zn.M is also monotone decreasing with n . Hence, an optimal trigger 
policy, attaining the supremum in (15T|) . is an n at which the sequence 



Wn,M - 1^ + Yl 

Zn+m,M f^m 



m=l 



crosses zero. Because both Wn^M and ^„,m are decreasing with M, the trigger is also 
decreasing with M . m 

Proof of Proposition 17.41 Suppose that is an equilibrium with M public signals, 
which we express as 

e Qa/(C^). 

By Lemma [731 we have 

C^^ e Qm-i(C^) 

for some A^i > . It follows from the algorithm at the end of Section [H] that there exists 
some N' > N with A^' G Qa/-i(C^'). The proof is completed by induction in M. ■ 
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